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[57] ABSTRACT 

Points on a pair of images obtained by imaging an object 
are finely corresponded in order to precisely measure 
the three-dimensional position of the object. For this 
purpose, attractive forces corresponding to features of 
the images are calculated, and the degree of correspon- 
dence between the points on the pair of images is evalu- 
ated relying upon the magnitude of the attractive force, 
in order to determine the corresponding points and to 
calculate the position of the object relying upon the thus 
determined corresponding points. Furth er, an occlud ed 
remon^wMch^contains.no^corresponding point is* de- 
te^4^and*is*removedj»in^order ^to-furthlsr^improve^the 
^p^e^on fbr^measuiing ^the^positioh. 

8 Claims, 8 Drawing Sheets 
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POSITION MEASURING METHOD 

BACKGROUND OF THE INVENTION 

The present invention relates to a position measuring 5 
apparatus, and particularly to a method of measuring 
the position or the distance of an object using a pair of 
image data obtained from the same object at difference 
positions or at different moments. The apparatus of this 10 
type is indispensable for a variety of equipment (such as 
robot having a sense of sight, automatic controller of a 
vehicle which responds to the external scenery, a pro- 
cess controller that works being interlocked to an ITV, 
and the like) which control devices relying upon image 15 
data. 

In the position measuring apparatus of the above- 
mentioned type, it is necessary to determine by the 
automatic processing a point of one image which corre- 
sponds to a point of the other image. A conventional 20 
method for this purpose can be represented by "Coop- 
erative Computation of Stereo Disparity" by D. Marr, 
T. Poggio, disclosed in "Science", Vol. 194,15, Octo- 
ber, 1976, pp. 283-287. Another conventional method is 
represented by "Method of Forming Depth Data Sig- 25 
nals for Three-Dimensional Televisions" disclosed in 
Japanese Patent Publication No. 10564/1985. 

The above first conventional method permits the 
operations to be performed concurrently, and is adapted 
to high-speed processing. According to this method, 30 
however, the correspondence is not so fine since corre- 
sponding relationships are found among the pixels for 
the image consisting of pixels that are quantized into 
two levels. That is, a pixel of an image cannot be corre- 
sponded to an intermediate position between a pixel and 35 
a pixel of another image. This makes it difficult to calcu- 
late a position maintaining high precision. Further, 
since it is allowed to treat only those images that are 
quantized into two levels, the pixels are erroneously 
corresponded, and therefore develop many points 
which greatly deviated from the calculated positions. 

The above second conventional method is also 
adapted to high-speed processing, in which two image 
signals are compared, and depth data of an object is ^ 
obtained from the deviation between the pixels at a time 
when signal waveforms are nearly brought into agree- 
ment. In comparing the signal waveforms, however, 
one image that is being shifted is compared with another 
image. Therefore, the position is found even for a pixel 50 
of an object that has been projected upon one image 
only. In fact, however, the distance cannot be found for 
a portion (occluded region) that has been projected on 
one image only. In order to obtain position data main- 
taining high precision, therefore, it is necessary to cor- 55 
rectly detect the occluded region and to remove it. 

SUMMARY OF THE INVENTION 

A first object of the present invention is to improve 
the precision for position measurement, by precisely 60 
corresponding the points between a pair of images. 

A second object of the present invention is to im- 
prove the precision for position measurement, by de- 
tecting the occluded regions at the time of effecting the 
above-mentioned corresponding operation and by re- 65 
moving incorrect correspondence. 

In order to achieve the above-mentioned first object, 
the present invention calculates an attractive force that 



393 

2 

corresponds to features (brightness, change of bright- 
ness of neighboring points, etc.) of a pair of images. 

For each point, there usually exist a plurality of cor- 
responding points at which a large attractive force can 
be exhibited. Among these corresponding points, there 
exists only one point that correctly corresponds. The 
invention makes use of the below-mentioned nature. 
That is, the depth usually changes smoothly , on the 
surface of an object, and discrete change takes place 
only at boundary lines of the object. In order to utilize 
this nature, a network is considered to connect the 
points of one image to the points of another image. 

Attractive forces are calculated among the corre- 
sponding points on the two images at the nodes (con- 
nection points) on the network, and corresponding 
points are determined from the distribution of evaluated 
values of the attractive forces. In order to find the distri- 
bution of attractive forces, a coefficient is introduced to 
evaluate the attractive forces, and the degree of corre- 
spondence is evaluated relying upon the product of the 
coefficient and the attractive force. A steady-state solu- 
tion is found by adjusting values of coefficient at the 
nodes on the network using the evaluated degree of 
correspondence of nodes in the vicinities of the above 
nodes. In this case, the evaluated values of attractive 
forces at the nodes represent the degrees of correspon- 
dence among points on the image corresponding to the 
nodes. 

Usually, deviation is very small among the corre- 
sponding points between the two images that are to be 
processed, and the number of points (number of nodes 
on the network) connected to points on the images is 
not so great. This fact makes it possible to put the auto- 
matic processing into practical use by employing the 
above-mentioned network. 

In order to achieve the above-mentioned second ob- 
ject, the present invention finds corresponding points of 
the other image (referred to as B) for all of the points of 
one image (referred to as A) and, conversely, finds 
corresponding points of the image A for all of the points 
of the image B. Thereafter, the invention detects por- 
tions where pairs of corresponding points are not in 
agreement, that are obtained in the respective process- 
ings. These portions are occluded regions. Measure- 
ment of positions excluding these portions contains 
erroneous correspondence in reduced amounts. 

In order to obtain a position data from a pair of image 
data, it is essential that the object from which the posi- 
tion data is to be obtained is projected onto both images. 
Corresponding points of a point projected onto both 
images form the same pair irrespective of from which- 
ever, one of them it is found. As for a point that is pro- 
jected onto one image,, however, there exists no similar 
point in the other image. When it is attempted to find a 
corresponding point from the other image, therefore, 
there is obtained no pair that corresponds to such a 
point By finding corresponding points from both of the 
pair of images, as described above, it is possible to re- 
move erroneous correspondence for the occluded re- 
gion. . 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram which illustrates a first 
embodiment of the present invention; 

FIG. 2 is a diagram explaining an epipolar. line of 
when an image is looked at by both eyes; 
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FIG. 3 is a schematic diagram of an image for ex- 
plaining the preprocessing when the image is looked at 
by both eyes; 

FIG. 4 is a diagram of a network for determining 
corresponding points on the corresponding scanning 5 
lines; 

FIG. 5 is a graph of weight coefficients used for 
updating the coefficient of the attractive force; 

FIG. 6 is a flow chart for explaining the processing 
procedure according to the present invention; 10 

FIG. 7 is a schematic diagram showing a relationship 
between positions of corresponding points on the image 
and positions of the points to be measured; 

FIGS. 8a %b, 9a and 9b are graphs showing the results 
of processing according to the present invention; 15 

FIG. 10 is a block diagram showing a second embodi- 
ment of the present invention; 

FIG. 11 is a diagram which explains a similarity table 
of pixels of a right eye image and a left eye image; 

FIG. 12 is a diagram which explains a method of 20 
finding corresponding points of the right eye image 
when the object is looked at by both eyes; 

FIG. 13 is a diagram which explains a method of 
finding corresponding points of the left eye image when 
the object is looked at by both eyes; and 25 

FIGS. 14c-e are diagrams showing results obtained 
by putting the invention into practical use. 



mined by three points, i.e., determined by a lens center 
22 of the right camera, lens center 23 of the left camera, 
and an object point P (see "Study of Image in the 
U.S.A.", Data Processing, Vol. 24, No. 12, p. 1449). 
The image data is stored in the image memory 12 being 
so modified that the epipolar line is brought into agree- 
ment with the corresponding scanning lines of the two 
images. With the data being stored in such a form, all 
that is needed is to examine the corresponding relation- 
ships between points on the corresponding scanning 
lines of the two images. 

Described below is the processing by the preproces- 
sor 13. In FIG. 3, reference numeral 31 denotes an 
image by the left eye, 32 denotes an image by the right 
eye, and 33 denotes a scanning line that serves as an 
object for determining the corresponding points and 
that is in agreement with the epipolar line. The prepro- 
cessor 13 takes up small regions 34/ (i=l, 2, . . . m) of 
nXn pixels inclusive of the scanning line 33, and calcu- 
lates the mean brightness of the small regions in accor- 
dance with the following equation, 



DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 



FIG. 1 is a block diagram of a position measuring 
apparatus according to a first embodiment of the pres- 
ent invention. Data that represent image picked up by a 
TV camera 11 are stored in an image memory 12. In the 
case of the three-dimensional view by both eyes, two 35 
images picked up simultaneously from different posi- 
tions will be stored. When there is a relative movement 
between a measuring system and an object being mea- 
sured, however, there may be stored two images that 
are picked up at different times. A processor 10, in this 40 
case, is comprised of a preprocessor 13, a corresponding 
point determining means 14, and a distance calculator 
15. The preprocessor 13 reads image data from the 
image memory 12, calculates mean brightness and 
change of brightness of neighboring points for each 45 
region of a suitably small size, and sends the results to 
the corresponding point determining means 14 which 
calculates corresponding relationships among the small 
regions relying upon the data that is received and sends 
an instruction to the preprocessor 13 based upon the 50 
calculated result. In response thereto, the preprocessor 
13 changes the size of the regions, executes the prepro- 
cessing and sets an initial value for calculation. The 
above processing is repeated a suitable number of times, 
and the calculated result of the corresponding relation- 55 
ships is sufficiently converged. The thus converged 
calculated result is then sent to the three-dimensional 
distance calculator 15 which calculates the positions. 

The above-mentioned processing at each of the por- 
tions will now be described in detail with reference to 60 
the case of the three-dimensional view with both eyes. 
In the case of the three-dimensional view with both 
eyes, two TV cameras 11 corresponding to the right 
and left eyes are provided at known positions. In this 
case, the operation for searching the corresponding 65 
points can be limited onto the epipolar line. Here, as 
shown in FIG. 2, the epipolar line is a line 21 of intersec- 
tion of images 24, 25 of the cameras with a plane deter- 
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where n denotes the number of pixels of one side of the 
small region, RI (x, y) and LI (x, y) denote quantities of 
brightness possessed by pixels of the right eye image 
and left eye image at a position (x, y), 1 dentoes a scan- 
ning line number with which the corresponding points 
are to be determined and the three-dimensional distance 
is to be found, and m denotes the number of small re- 
gions. 

Using the thus found brightness of the small regions, 
the change of brightness (differential value) will now be 
calculated in compliance with the following equation, 



(2) 



BLiO = . 'I* AL<f> ,-L=f . expf - JL=JL ) 



where d denotes a constant that represents the width of 
a proximity that is to be differentiated, and <r\ denotes a 
parameter for effecting the differentiation and smooth- 
ing simultaneously. 

The foregoing describes the contents of the process 
performed by the preprocessor 13. The corresponding 
point determining means 14 will now be described. The 
corresponding point determining means 14 presumes a 
network that is shown in FIG. 4, and calculates the 
attractive forces at each of the nodes on the network. 
FIG. 4 shows a network in which differential values BR 
(i) for the right eye image are indicated by points 46 in 
the direction of ordinate, differential values BL (j) for 
the left eye image are indicated by points 47 in the 
direction of abscissa, and nodes are connected from the 
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points of one image to the points of the other image. the decimal part represents a point between the small 

Points on the image to be connected to the points i can, region and the next small region, 

in practice, be limited to the opposing points and to a Next, the procedure of calculations will be described 

suitable number of proximity points. FIG. 4 illustrates i n detail using a flow chart of FIG. 6. First, a step 61 

only nine points. 5 finds an average brightness of the small regions in com- 

The corresponding point determining means 14 per- pliance with the equation (1), and sets an initial value R 

forms the calculations of the following calculation pro- (\ f j). At the time of starting the calculation R (i, j) 

cedures (II) and (III) several times for the network, and should be set to a suitable value of, for example, about 

determines the corresponding points when the steady- 5 0. Using the average brightness of the small regions, a 

state solution is nearly reached; i.e., 10 next ste p 62 calculates a differential value in compliance 

(I) Set initial values of coefficient R (i, j) of attractive with the equat i on (2 ). Using the differential value, a step 
forces for each of the nodes. 63 and a step 54 rep e a ts the calculation X (i, j) in compli- 

(II) Calculate the corresponding degree X (l, j) for ance with thc equation (3) and the calculation R (i, j) in 
each of the nodes in accordance with the following compliance wit h the equations (4) to (7) several times, 
equation, 15 jh e parameter 0-2 of the equation (3) is gradually re- 
duced while repeating the calculation, and the corre- 

[{BR(0 - BL(f)} z "I ^ spondence is made fine gradually. After the steps 63 and 
_ — J are re peated several times, the process returns to the 
07 step 62 which performs the calculation in accordance 

, , , , . . . . 20 with the equation (2) with a decreased parameter cr\ to 

where 07 denotes a parameter for determining the mag- ^ ^ value fme Thetl( ^ steps 63 and 

S U^SSSSSr 0, J) of attractive force £ repeat ^calculations. After these calculations have 
for each of the nodes according to the following equa- been finished, a step calculates the corresponding 
tion 0 25 P omts » a 11 ^ ^ process returns to the step 61. The step 

1 ' reduces the size n of the region for finding the average 

brightness, and performs the calculation in compliance 
with the equation (1) and then sets the initial value R (i, 
where, j) in compliance with the following equation based 

30 upon the result of calculating the corresponding points 
a*G/> = 2 + Kf) + AW + fcj)} (3) of the step 65, 

R (/. y) = l0.0-{/-(r+/>'/)} 2 (10) 



RV.J) = RiU) + 0 • (4) 



k=-l 

1 (6) 



where R (i, j)=0.0 when R (i, j)<0.0, and p/ denotes 
/ (7) tne amount of deviation of a point of the left eye image 

&Ry(i,j) = 2 w{k) - X(i + kj) to w hich is corresponded a point i of the right eye image 

on a new network as found from the result of the step 
wherein w denotes a weight coefficient for the evalu- 65. 

ated value X of attractive force and represents a value 40 Calculations of the steps 62 to 65 are repeated using 
of function shown in FIG. 5, denotes a suitable cor- the initial value of the equation (10). 
rection coefficient, and 1 denotes a constant that indi- The above-mentioned calculations are repeated while 
cates the width for weighting (e.g., 1=4 in FIG. 5). gradually decreasing the size n of the small region from 
When the steady solution is obtained as described which the mean brightness is to be found, thereby to 
above, the corresponding points are found in accor- 45 finally find the corresponding points, 
dance with the following equations, In the foregoing was mentioned the processing pro- 

cedure by the corresponding point determining means 
14. Here, the equations (4) to (7) have meanings as de- 
f jm+a jm+o ^ scribed below. In an environment in which a moving 

Pi = ;=ym-a Q ' Jm) ' X{LJ)/ j=jfk-a *^ + !m so member undergoes the movement, in general, it is con- 

^ sidered that the surface of the object changes smoothly 
jm{j; maxXfyy = u + l, . . . , i + s} on most of the places (hereinafter referred to as continu- 

^ j ity assumption), and the distance changes little among 

the neighboring pixels. As the equations (4) to (7) indi- 
wner e 55 cate, if there is a node having a large evaluation value of 

p/: small region number of the left eye image corre- attractive force, the continuity assumption is satisfied by 
sponding to an i-th small region of the right eye so updating the coefficient R (i, j) of attractive force 
image, and using the weighting w that it increases toward the nodes 

a: constant that indicates the width for finding corre- in the proximity of the above node and that it decreases 
sponding points. 60 as it separates away from the above node, and further 

The equations (8 ) and (9) indicate that the greatest effecting the updating using the abovesaid weighting 
evaluation value of attraction is selected from the node (Le., weighting that becomes a maximum at i±l) even 
connected to the i-th small region of the right eye im- for the node connected to a point (i± 1) in the proximity 
age, and the evaluation values of attractive forces of of L 

nodes that lie within a width of ±a with the abovesaid 65 The distance calculator 15 will now be described in 
node as a center, are added up and averaged with the conjunction with FIG. 7, wherein Vl and vr denote 
distance among the nodes as weight When the small center coordinates of optical systems of the left and 
region p ( * contains a decimal part, it is interpreted that right cameras. ?i (x/,, y/,) and P/i (x/t, yn) denote posi- 
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tions of an image formed on the image planes of the left 
and right cameras by a point P (x, y, z) on the surface of 
an object located in front, and f denotes a focal distance 
of the lens. In this case, as is well knonw, the position of 
the point P is given by, 5 



X X L ~~ X R 

-v L + Vr 



(11) 



' XL - *R 

yd-vc* yjQ 

XL - 



10 



Based upon (xr, y/0» (x^, yi) at each of the points 15 
calculated by the corresponding point determining 
means 14 and the equation (11), the distance calculator 
15 calculates three-dimensional distances of each of the 
points on the object that correspond to the points on the 
images. 20 

The results of processing obtained according to this 
embodiment are shown in FIGS. 8 and 9, FIGS. 8(c) 
and 8(6) are a right eye image and a left eye image on a 
pair of corresponding scanning lines stored in the image 
memory 12, wherein the abscissa represents a pixel 25 
number and the ordinate represents the brightness. In 
response to the image data, the preprocessor 13 calcu- 
lates mean brightness and a differential value for each 
small region consisting of 2x2 pixels, and the corre- 
sponding point determining means 14 calculates the 30 
corresponding points. Then, using this result, an initial 
coefficient value R (i, j) for calculating attractive force 
is determined, and the calculations are carried out using 
mean brightness of each of the small regions of 1 X 1 
pixel. The results finally obtained by the corresponding 35 
point determining means 14 are shown in FIG. 9(a), 
wherein the abscissa represents the pixel number and 
the ordinate represents the number of pixels by which 
the left eye image is deviated with respect to the right 
eye image. Here, the calculated results are directly 40 
indicated only for those pixels having large absolute 
differential values, and the points are interpolated for 
other pixels. FIG. 9(b) shows the distance (depth) in the 
direction y calculated by the three-dimensional distance 
calculator 15 based upon FIG. 7. 45 

In the foregoing was described the embodiment in 
which the object was looked at by both eyes. The in- 
vention, however, is not limited to the case only where 
the corresponding points are found on the correspond- 
ing scanning lines only but can also be adapted to the 50 
case where the corresponding points are to be found 
over a two-dimensional region such as images obtained 
by imaging an object at different moments, the object 
undergoing a relative displacement in a given direction. 

Described below is an embodiment which detects a 55 
occluded region to measure the position/ w 

'FIGrHTLTa block diagram of 'apposition measuring 
apparatus according to a second embodiment of the 
present invention. Data representing a pair of images 
picked up by TV cameras 10 and vllare once stored in 60 
image memories 12 and 113. In the case of the three-di- 
mensional vievT by~both eyes, two images simulta- 
neously picked u p aV dif £erenttLpositipnS:_areijstored. 
When the TV camera undergoes the movement, how- 
ever^only^one TV camera may-be used, and two images 65 
(picked up at different moments may^be-stored-in-the 
4mage^memoriesIH~and--il3?A similarity table 114 
stores similarities among-the-pomtsJound by-using-theP 



c 



image ^ataof_the_ image meirwriesll2. and - J 13. Corre- 
sponding point ^determining^ means 115 and 116 read 
data of similarities from the similarity table 114, and 
calculate corresponding points between one image and 1 
the^other image. The corresponding point determining 
means 115 calculates points that correspond to points of 
the image of the image memory 12, and the correspond- 
ing point determining means 116 calculates points that 
correspond to points of the Jmage of the image memory 
113. Thecalculated results are sent to axccluded region E 
pick-up meaWll7 which examines whether the pairs of 
the corresponding points are in agreement or not, and 
picks up the points that are not in agreement as a oc- 
cluded region. A position measuring means calculates 
the positions of the points excluding the occluded re- 
gion relying upon the amount of deviation of the corre- 
sponding points. 

The processing in each of the above-mentioned por- 
tions will now be described in detail with reference to 
the case of three-dimensional view by both eyes. In the 
case of the three-dimensional view by both eyes, the 
corresponding points can be searched within the corre- 
sponding scanning lines of the two images as has been 
disclosed in U.S. patent application Ser. No. 723,141 
filed Apr. 15, 1985 now abandoned. Here, the images 
stored in the image memories 12 and 113 are presumed 
to be those that are picked up by the TV cameras 10 and 
11, and are thus converted. The following description 
deals with the processing for a pair of scanning lines of 
such images. 

The similarity table 114 stores similarities found by 
using the image data of the right eye image and the 
image data of the left eye image. That is, as shown in 
FIG. 11, at a point A (i, j) is stored a similarity of an i-th 
pixel of the right eye image and a j-th pixel of the left 
eye image. The width of the table should be suitably 
determined depending upon a range for measuring the 
positions. For example, when the deviation between the 
right eye image and the left eye image is within k pixels, 
the value of table should be found within a range of 
i-k^j^i+k. 

The similarity is found in accordance with the follow- 
ing equation, 



A(Lj)={R{i)-L(j)}Z 



(12) 



(13) 



using brightness values R (i) and L (j) at the points of 
the right eye image and the left eye image. Further- 
more, the similarity may be found in accordance with 
the equation, 



A{uj)=\DR®-DUj)\ 



A&fl^DRW-DLm 1 



(H) 



(15) 



using the change quantities DR (i) and DR (j) of bright- 
ness at the points of the right eye image and the left eye 
image. 

The corresponding point determining means 115 and 
116 perform the processing as described below to find 
corresponding points. First, the corresponding point 
determining means 115 sets a small region of a suitable 
width with a point (pixel) of the left eye image as a 
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center as represented by a hatched area in FIG. 12, to 
find, 



ARia{d) = t ta i Q A(U + d)((0T d = -k ~ k) 



(16) 



i—ia—a 



In the equation (16), if a value d that makes ARia (d) 
a maximum is denoted by da, then da represents a devia- 
tion amount of the left eye image from the ia-th pixel of 
the right eye image. That is, the ia-th pixel of the right 
eye image and the (ia+da)th pixel of the left eye image 
form a pair of corresponding points. This processing is 
effected for all pixels of the right eye image to find 
corresponding points between the right eye image and • 
the left eye image. Next, the corresponding point deter- 
mining means 116 sets a small region of a suitable width 
with a point (pixel) of the left eye image as a center as 
represented by a hatched area in FIG. 13, to find, 



ALja(d) = / I 



A<j + 4/)(for d = —k ~ k) 



(17) 



20 



In the equation (17), if a value d that makes ALja (d) 
a maximum is denoted by da, then da represents a devia- 25 
tion amount of the right eye image from the ja-th pixel 
of the left eye image. That is, the ja-th pixel of the left 
eye image and the (ja+da)th pixel of the right eye 
image form a pair of corresponding points. 

The occluded region pick-up means 117 picks up a 30 
occluded region using the results of the corresponding 
point detennining means 115 and 116. The procedure 
for this operation will now be described with reference 
to FIG. 14. FIGS. 14(a) and 14{b) illustrate right eye 
image and left eye image, and wherein A- A' represents 35 
a pair of scanning lines for finding the corresponding 
points. It is now presumed that FIG. 14(c) shows the 
points of the left eye image to which the points of the 
right eye image are corresponded as found by the corre- 
sponding point determining means 115, and FIG. 14(d) 40 
shows the points of the right eye image to which the 
points of the left eye image are corresponded as found 
by the corresponding point detennining means 116. The 
occluded region pick-up means 117 finds common por- 
tions of corresponding points of FIGS. 14(c) and 14(d), 45 
removes corresponding points in the occluded regions, 
and obtains corresponding points as shown in FIG. 
14(e). Concretely speaking, corresponding points of 
pixels of the right eye image are successively taken out. 
When, for example, a point to which an ia-th pixel of the 50 
right eye image corresponds, is a ja-th pixel of the left 
eye image, it should be examined whether a point to 
which the ja-th pixel of the left eye image corresponds 
is in agreement with the pixel number ia of the right eye 
image. When they are not in agreement, the corre- 55 
sponding points are those of the occluded region and 
should be removed from the pairs of corresponding 
points. 

The position measuring means 118 calculates the 
position of the object relying upon the corresponding 60 
point pairs from which the corresponding points of 
occluded regions have been removed by the occluded 
region pick-up means 117. The position of the object is 
calculated relying upon the coordinates of the corre- 
sponding point pairs in the right eye image and the left 65 
. eye image, center coordinates of optical systems of the 
TV cameras, and the focal distance of the lens (see U.S. 
Ser. No. 723,141 mentioned earlier). 



The foregoing description has dealt with embodi- 
ments of when an object was looked at by both eyes. 
The present invention is not limited to only the case 
where the corresponding points are to be found on the 
corresponding scanning lines such as when an object is 
looked at by both eyes, but can also be adapted to the 
case where the corresponding points are to be found 
over a two-dimensional range such as when an object is 
imaged at different moments, the object undergoing 
relative displacement in a given direction. 

According to the present invention as described 
above, dense and pale data of image can be directly used 
(without digitizing them into binary values) to deter- 
mine the corresponding points. Furthermore, it is al- 
lowed not only to correspond one pixel to another pixel, 
but also be correspond a pixel of one image to a position 
between the pixels of the other image, contributing to 
increasing the precision for measuring the position or 
the distance. 

According to the present invention, furthermore, it is 
easy to pick up a portion (occluded region) of an outer 
world projected upon only one of the pair of images. 
That is, the position is measured with the above portion 
being removed, and the measurement of position fea- 
tures improved reliability. 

What is claimed is: 

1. A position measuring method comprising the steps 

of: 

inputting a pair of image data representing an image 
of a picture of an external world; 

processing the input image data to calculate a distri- 
bution of attractive forces generated between fea- 
tures of points of one image and features of points 
of an other image; 

determining pairs of corresponding points on the 
images based upon said distribution; and 

calculating positions of points of the external world 
corresponding to said corresponding points based 
upon relationships between positions of the pairs of 
the corresponding points. 

2. A position measuring method according to claim 1, 
wherein a feature at each of the points of the images is 
brightness. 

. 3. A position measuring method according to claim 1, 
wherein a feature at each of the points of the images is 
a changing quantity of brightness at a point in proximity 
to each of the points. 

4. A position measuring method comprising the steps 
of: 

inputting a pair of image data representing an image 
of a picture of an external world; 

processing the input image data to find corresponding 
points of one image from the points of another 
image that form pairs of corresponding points; 

determining pairs of corresponding points of a pair of 
first and second images by picking up only those 
corresponding points that lie within a predeter- 
mined number of pixels that are in agreement with 
the pairs of corresponding points found in the pro- 
cessing step; and 

calculating a position of a point of an external world 
corresponding to said corresponding points based 
upon a relationship of positions between the pairs 
of the corresponding points. 

5. A position measuring method according to claim 4, 
wherein said processing step is performed by finding a 
point on the second image that forms a pair relative to 
a predetermined point on the first image, or by finding 
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a corresponding point on the first image for a predeter- 
mined point on the second image when there are a plu- 
rality of corresponding points. 

6. A position measuring method according to claim 4, 
wherein said predetermined point is a feature point in 
each of the images. 

7. A position measuring method according to claim 6, 
wherein the feature point in each of the images is se- 



12 



lected depending upon the magnitude of change of an 
brightness of image in proximity to the corresponding 
points. 

8. A position measuring method according to claim 4, 
wherein said corresponding points are determined 
based upon similarities of small regions set on the first 
image and small regions set on the second image. 
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